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Abstract 


This study intends to explore the current trends in the field of distance education research 
during the period of 2009-2013. The trends were identified by an extensive review of seven peer 
reviewed scholarly journals: The American Journal of Distance Education (AJDE), Distance 
Education (DE), The European Journal of Open, Distance and e-Learning (EURODL), The 
Journal of Distance Education (JDE), The Journal of Online Learning and Technology (JOLT), 
Open Learning: The Journal of Open, Distance and e-Learning (OL) and The International 
Review of Research in Open and Distributed Learning (IRRODL). A total of 861 research 
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articles was reviewed. Mainly content analysis was employed to be able to analyze the current 
research. Also, a social network analysis (SNA) was used to interpret the interrelationship 
between keywords indicated in these articles. Themes were developed and the content of the 
articles in the selected journals were coded according to categories derived from earlier studies. 
The results were interpreted using descriptive analysis (frequencies) and social network 
analysis. The reporting of the results were organized into the following categories: research 
areas, theoretical and conceptual frameworks, variables, methods, models, strategies, data 
collection and analysis methods, and the participants. The study also identified the most 
commonly used keywords, and the most frequently cited authors and studies in distance 
education. The findings obtained in this study may be useful in the exploration of potential 
research areas and identification of neglected areas in the field of distance education. 

Keywords: Distance education trends; distance education issues; research evaluation; content 
analysis 


Introduction 

There has been a profound change globally, particularly in terms of scientific developments and 
social changes. One aspect of this is the way in which technology has become an essential part of 
our lives. The impact that this has had on society in general is becoming more and more visible, 
with the result that technology is now very much expected to be used in the proliferation of 
information. As a direct consequence of these expectations, there has been a parallel paradigm 
shift in education. 

According to Harasim (2000), the invention of the Web technologies made online education 
increasingly accessible, open, flexible; allowed new pedagogical models to emerge and reasoned 
the revolution in digital knowledge age that enabled greater and faster human communication 
and collaboration and led to fundamentally new forms of economic activity that produced the 
knowledge economy and required basic changes in education. Educators embraced the 
revolution, and the increased educational opportunities and especially the new learning models 
that have emerged are now influencing education and society as a whole. The 21st century thus 
begins with a paradigm shift in attitudes towards online education. Online learning is no longer 
peripheral or supplementary, yet an integral part of mainstream society. Our new understanding 
of the very nature of learning has affected the definition, design, and delivery of education. 
Paradigm shift in education has resulted in: new modes of educational delivery, new learning 
domains, new principles of learning, new learning processes and outcomes and new educational 
roles and entities. 

Distance education (DE) as a multidisciplinary field has reacted to these changes; it has and is 
still evolving and orienting itself to fulfill this demand. Thus, as the demands of educators and 
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learners evolve, it is crucial to understand and get a deeper insight of trends and issues in DE so 
as to keep abreast of these constant changes. This study was conducted in direct response to this 
demand and aims to help educators and researchers spot recent DE trends by studying written 
scholarly documents, that is to say to provide a comprehensive list of “mute evidence” (Hodder, 
1994) in the field. 


Literature Review 

In recent years, research has been conducted to investigate DE research trends. One of the first 
studies to investigate trends in DE was carried out by Berge and Mrozowski (2001), who 
examined research literature in DE over a ten-year period from 1990 to 1999. Categorization of 
the articles (N=89o) was based on Sherry’s (1996) ten research issues, namely redefining the 
roles of key participants, technology selection and adoption, design issues, strategies to increase 
interactivity and active learning, learner characteristics, learner support, operational issues, 
policy and management issues, equity and accessibility, and cost/benefit trade-offs. According to 
the results obtained, it was seen that pedagogical themes such as design issues, learner 
characteristics, and strategies for active learning were the most frequent topics used in the field. 
Also, the most prevalent research methodology was descriptive methodology. 

Lee, Driscoll and Nelson (2004) also examined research topics, methods and citation trends in 
four journals: The American Journal of Distance Education (AJDE), the Journal of Distance 
Education (JDE), Distance Education (DE) and Open Learning : The Journal of Open, Distance 
and e-Learning (OL). Three hundred and eighty-three articles e-published between 1997 and 
2002 were selected from these journals and they classified the articles into six themes: design- 
related, development-related, management-related, evaluation-related, institutional and 
operational-related, and theory and research-related. The thematic analysis method was used to 
explore core meanings. The results of this research yielded six topics: general research topics, 
research specific topics, the research method, the statistical method used in experimental studies, 
a citation of the authors, and the cited books and articles/chapters. 

A series of studies were conducted by Zawacki-Richter to explore the DE research domain. The 
first study (Zawacki-Richter, 2009) used a Delphi technique to develop a classification of research 
areas. The second study (Zawacki-Richter, Backer and Vogt, 2009) identified gaps and priority 
areas and analyzed 695 articles published in five prominent DE journals between 2000 and 2008. 
The third study (Zawacki-Richter and von Priimmer, 2010) carried out an analysis of the impact 
of gender and collaboration patterns among researchers in research methods, research topics and 
research productivity. 

In his study, Zawacki-Richter (2009) developed a categorization of research areas in DE and 
identified the most important and the most neglected research areas in DE. Having conducted an 
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extensive literature review and a Delphi study with expert responses from editorial board 
members from the major DE journals from September-December 2008, Zawacki-Richter 
identified 15 research areas which were organized into 3 broad categories. The participants of the 
study were 19 voluntary experts with an average of 27 years of professional experience in DE who 
had made significant contributions to DE literature. Based on the experts’ responses, Zawacki- 
Richter grouped the 15 research areas into three categories. In the second round of the Delphi 
study, presented in Table 1, each category was prioritized by the experts. 

After comparing the results of the study with a previous study by Jegede (1994) in Australia, 
Zawacki-Richter concluded that the priority of DE research areas have not changed drastically, 
yet it was noted that innovations in online learning led to a shift from technology centered 
research to a research of management and change in DE institutions. It was noted that the 
emergence of online distance learning highlights a pressing need for educational institutions to 
embrace innovation and change. Delphi experts agreed that the areas of innovation and change 
and quality assurance should be prioritized as research areas while faculty support and 
professional development along with “Web 2.0 applications, mobile devices, and synchronous 
tools afford for teaching, learning, and assessment” also deserved further attention. 
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Table 1 

Classification of Research Areas in Distance Education (Zawacki-Richter et al., 2009) 


Macro level: Distance education systems and theories. 

1. Access, equity, and ethics: The democratization of access to distance education afforded by new media and by 
finding ways to deliver high-quality education to those who have limited resources and poor infrastructure; issues that 
refer to the (sustainable) provision of distance education in developing areas. What is the impact of distance education 
(e.g., via mobile learning) on narrowing the digital divide and what is the role of ICT (information and communication 
technologies) and/or OER (open educational resources) in terms of access to education? 

2. Globalization of education and cross-cultural aspects: Aspects that refer to the global external environment and 
drivers, the development of the global distance education market, teaching and learning in mediated global 
environments, and the implications for professional development. 

3. Distance teaching systems and institutions: Distance education delivery systems, the role of institutional 
partnerships in developing transnational programmes, and the impact of ICT on the convergence of conventional 
education and distance education institutions (hybrid or mixed mode). 

4. Theories and models: Theoretical frameworks for and foundations of distance education, e.g., the theoretical basis of 
instructional models, knowledge construction, interaction between learners, or the impact of social constructivism 
learning theories on distance education practice. 

5. Research methods in distance education and knowledge transfer: Methodological considerations, the impact of 
distance education research and writing on practice, and the role of professional associations in improving practice. 
Literature reviews and works on the history of distance education are also subsumed within this area. 

Meso level: Management, organization, and technology. 

6. Management and organization: Strategies, administration, and organizational infrastructures and frameworks for 
the development, implementation, and sustainable delivery of distance education programmes. What is required for 
successful leadership in distance education? Distance education and policies relating to continuing education, lifelong 
learning, and the impact of online learning on institutional policies, as well as legal issues (copyright and intellectual 
property). 

7. Costs and benefits: Aspects that refer to financial management, costing, pricing, and business models in distance 
education. Efficiency: What is the return on investment or impact of distance education programmes? What is the 
impact of ICT on the costing models and the scalability of distance education delivery? How can cost effective but 
meaningful learner support be provided? 

8. Educational technology: New trends in educational technology for distance education (e.g., Web 2.0 applications or 
mobile learning) and the benefits and challenges of using OERs, media selection (e.g., synchronous vs. asynchronous 
media), technical infrastructure and equipment for online learning environments, and their opportunities for teaching 
and learning. 

9. Innovation and change: Issues that refer to educational innovation with new media and measures to support and 
facilitate change in institutions (e.g., incentive systems for faculty, aspects referring to staff workloads, promotion, and 
tenure). 

10. Professional development and faculty support: Professional development and faculty support services as a 
prerequisite for innovation and change. What are the competencies of online teachers and how can they be developed? 

11. Learner support services: The infrastructure for and organization of learner support systems (from information and 
counselling for prospective students about library services and technical support to career services and alumni 
networks). 

12. Quality assurance: Issues that refer to accreditation and quality standards in distance education. The impact of 
quality assurance and high quality learner support on enrolments and dropout/ retention, as well as reputation and 
acceptance of distance education as a valid form of educational provision. 

Micro level: Teaching and learning in distance education. 

13. Instructional design: Issues that refer to the stages of the instructional design process for curriculum and course 
development. Special emphasis is placed on pedagogical approaches for tutoring online (scaffolding), the design of 
(culturally appropriate) study material, opportunities provided by new developments in educational technology for 
teaching and learning (e.g. Web 2.0 applications and mobile devices), as well as assessment practices in distance 
education. 

14. Interaction and communication in learning communities: Closely related to instructional design considerations is 
course design that fosters (online) articulation, interaction, reflection, and collaboration throughout the learning and 
teaching process. Special areas include the development of online communities, gender differences, and cross-cultural 
aspects in online communication. 

15. Learner characteristics: The aims and goals of adult learners, the socioeconomic Background of distance 
education students, their different learning styles, critical thinking dispositions, and special needs. How do students learn 
online (learner behavior patterns, learning styles) and what competencies are needed for distance learning (e.g., digital 
literacy)? 


Zawacki-Richter’s study is limited to English speaking experts, but it is significant to note that the 
participants reflect the ideas of DE professionals across different countries and continents 
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(Australia, Brazil, Canada, China, Fiji, Germany, Ireland, New Zealand, South Africa, UK, and 
USA). Therefore, although the results may not be valid for some non-English speaking settings, 
the fact that the participants come from different schools of thought makes the study rigorous in 
reflecting the major research areas of study in DE. 

In their follow up study, Zawacki-Richter et al. (2009) used their typology of issues to categorize 
695 articles, published between 2000 and 2008 in The American Journal of Distance Education 
(AJDE), Distance Education (DE), The International Review of Research in Open and 
Distributed Learning (IRRODL), The Journal of Distance Education (JDE) and Open Learning: 
The Journal of Open, Distance and e-Learning (OL). The articles were drawn from a wide variety 
of topics within the scope of DE research. They concluded that issues about instructional design, 
interaction and communication patterns in computer-mediated communication, learner 
characteristics, and educational technology dominated DE research. 

One of the major findings of this research was their attempt to tabulate the diversity of research 
methods employed in DE. Zawacki-Richter et al. (2009) found that qualitative research methods 
were more widely used than other methods. Another significant trend is collaboration among 
researchers. The researchers concluded that the proportion of single-authors was 44.2% in the 
period between 2000 and 2008. Another research by Mishra (1997) concerning the collaboration 
of authors concluded that 61.5% of articles were published by a single author between 1991 and 
1996. 

Zawacki-Richter and Anderson (2014) went one step further and provided a comprehensive 
survey on the state of online distance education as an independent field of inquiry, while also 
offering a clear orientation for future research. In their book Online Distance Education: 
Towards a Research Agenda these research areas were discussed by leading DE researchers to 
draw on their expert knowledge and professional experience to give an overview of the state of the 
art in each research area and derive research needs based on that. Zawacki-Richter and Anderson 
(2011), additionally, conducted a study to analyze the relationships and influences of 12 DE 
journals using bibliographic description and social network analysis to investigate the structure 
and patterns of information exchange within the field of DE research. 


Purpose and Research Questions 

DE is prone to continuous change in line with developments in technology and learning sciences, 
a situation that opens the field up to new research areas in very short time spans. Moreover, 
recent developments in open educational resources and massive open online courses (MOOCs) 
have given the field a new dimension which has brought its own dynamics with it. Therefore, 
there is a need to mirror the DE field to be able to understand and interpret the new dynamics, 
namely DE trends. Berge and Mrozowski (2001) between 1990-1999 and Zawacki-Richter et al. 
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(2009) between 2000-2008 presented research trends in DE. Therefore, the year 2008 was 
chosen as cutoff date for this study and authors examined the articles published between 2009- 
2013 as a follow up research. The main goal of this study was to analyze the research articles 
published in seven widely accepted journals in the field to be able to explore the current trends in 
the field of DE research during the period 2009-2013. For this purpose the following research 
questions were considered: 

What are the most frequent/ly 

1. indicated keywords, 

2. chosen research areas, 

3. emphasized theoretical/conceptual backgrounds, 

4. employed research designs, 

5. used data collection instruments and data analysis techniques, 

6. focused variables, 

7. targeted population and/or participant groups, 

8. cited references, 

9. cited authors 

in DE research articles between 2009 and 2013? 


Methodology 


Research Design 

For the purposes of the study, the authors chose to use content analysis to study empirical 
documentation. Content analysis has been defined as a systematic, replicable technique for 
compressing many words of text into fewer content categories based on explicit rules of coding 
(Berelson, 1952). Since content analysis is a method of analyzing written, verbal or visual 
communication messages which includes both qualitative and quantative approaches (Elo & 
Kyngas, 2008), it was deemed to be the most appropriate for the intent of this study. The authors 
developed and set the criteria for the themes to be studied and the content of articles in the 
selected journals was then coded according to these pre-set categories. Following the content 
analysis, the findings were reported using descriptive analysis. Later, a social network analysis 
This work is licensed under a Creative Commons Attribution 4.0 International License. 
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was employed to analyze keywords in the selected articles to achieve a deeper comprehension 
and distinguish the links between them. 

Sample 

Seven journals were reviewed for this study: The American Journal of Distance Education 
1 AJDE 1 . Distance Education IDE). European Journal of Open Distance and e- Learning 
(EURODL) . Journal of Distance Education fJDEl. Journal of Online Learning and Technology 
fJOLT). Open Learning: The Journal of Open, Distance and e-Learning fOLl . The International 
Review of Research in Open and Distributed Learning fIRRODL) . The selection of the journals 
was based on a preliminary review of journals in DE and educational technology. In the first 
round, 82 journals were identified. The journals to be reviewed were filtered using the following 
criteria: 


• a specific focus on DE and open and distance learning context, 

• refereed journals that are indexed by prominent databases, 

• a publication history of 10 years or more, 

• publication of articles in English (with the exception of Journal of DE which also 
publishes a very limited number of articles in French). 

Following the selection of the journals, a thorough review was made of all articles published 
between 2009-2013 (N = 1,225). Of these, 861 were identified as research articles and the others, 
that is to say 364, were identified as other (editorials, book reviews, interviews, concept papers, 
position papers, reflection papers, field notes, technical notes, etc.). For this study, only the 
research articles were used. 

The research area classification schema that is used in this study is based on Zawacki-Richter’s 
(2009) study, explained in the introduction and shown in Table 1. This research category and area 
schema was adopted since it is rigorous due to its being based upon the views of experts in the 
field of DE. 

Categories related to methodology for coding largely follow those identified in Creswell (2012). 
When a study did not fit into the categories identified by Creswell, the name of the method that 
the writer of the article used was added into an existing category based on similarity of method 
with others in that category. 

Reliability 

To increase reliability, thirteen researchers who have the same background in the Distance 
Education Department at Anadolu University participated in this study. The researchers were 
trained before conducting the study and the pre-set categories were defined before the review 
process. Review of the articles took place in two rounds. Articles published annually were 
reviewed by two researchers in the first round and a different set of two researchers cross-checked 
and reviewed the selected articles again in the second round. Disagreed issues were discussed 
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within the group and coded only after the researchers who had reviewed those articles reached a 
concensus. 

The research question regarding research areas (Table 1) in DE was coded in the first round with 
10 raters (2009: A-B; 2010: C-D; 2011: E-F; 2012: H-I; 2013: J-K). In the second round, the same 
raters (2009: L-M; 2010: O-P; 2011: Q-R; 2012: S-T; 2013: V-W) were assigned as pairs for 
different years. Inter-rater reliability for 2009, between rater A and L, was k = .740; between B 
and M, it was k = .714. For 2010, between rater C and O, it was k = .744; between D and P, it was k 
= .760. For 2011, between rater E and Q, it was k = .813; between F and R, it was k = .783. For 
2012, between rater H and S, it was k = .728; between I and T, it was k = .837. For 2013, between 
rater J and V, it was k = .842; between K and W, it was k = .826. 

Table 2 

Cohen's Kappa Values for Inter-Coder Reliability 


Rounds 



Years 




2009 

2010 

2011 

2012 

2013 

1 st 

round 

A and L, 

K = .74O 

C and O, 

K = .744 

E and Q, 

k = .813 

H and S, 
ic = .728 

J and V, 
k = .842 

2nd 

round 

B and M, 

K = .714 

D and P, 
k = .760 

F and R, 
k = .783 

I and T, 

K = .837 

K and W, 

K = .826 


Altman (1991) proposed that the extent of agreement can be qualified as poor (< 0.20), fair (0.21 
to 0.40), moderate (0.41 to 0.60), good (0.61 to 0.80) and very good (0.81 to 1.00). Thus, the 
reliability of raters A-L, B-M, C-O, D-P, F-R and H-S can be considered as acceptable. Besides, the 
reliability of raters E-Q, I-T, J-V and K-W can be considered as quite acceptable. 


Findings and Discussion 

For this study, 1,225 articles were examined (Table 3). A total of 364 articles were excluded and 
861 articles were included to content analysis and examined through the criteria determined. 
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Table 3 


Journals and Number of Articles 


JOURNALS 

2009 

2010 

2011 

2012 

2013 

TOTAL (N) 

American Journal of Distance Education (AJDE) 

29 

25 

24 

25 

31 

134 

Distance Education (DE) 

32 

25 

33 

31 

28 

149 

European Journal of Open, Distance and E- 
Learning (EURODL) 

16 

12 

12 

30 

23 

93 

Journal of Distance Education (JDE) 

29 

31 

23 

13 

10 

106 

Journal of Online Learning and Teaching (JOLT) 

59 

76 

54 

29 

45 

263 

Open Learning: The Journal of Open, Distance 
and e-Learning (OL) 

26 

27 

27 

17 

25 

122 

The International Review of Research in Open 
and Distance Learning (IRRODL) 

85 

39 

79 

75 

80 

358 

ALL ARTICLES 

276 

235 

252 

220 

242 

1225 

EXCLUDED* 

110 

66 

89 

41 

58 

364 

INCLUDED 

166 

169 

163 

179 

184 

861 


*Editorials, book reviews, interviews, concept papers, position papers, reflection papers, field notes, technical notes, FYIs, 
CIDER notes 


Keywords Indicated 

The first finding of the research is based on a descriptive keyword analysis with an assumption 
that keywords indicated in the articles provide a holistic reflection of the research paper topics. In 
this study a total of 4,088 keywords (633 field specific and 3,455 research related) were included 
in the study and ranked according to their frequency. Later, the field and the research specific 
keywords were also analyzed separately. 

Figure 1 shows the field specific keywords. As can be observed in Figure 1, the term “distance 
education” is a generic term used to define this field. Another interesting finding concerns the 
word “online” which is used as a descriptive term. It may be concluded that DE is getting more 
dependent on the online technologies and there is a shift from traditional learning environments 
or media to online learning environments or media. As a final remark, the term open and distance 
learning (ODL) has appeared in increasing frequency especially in the last two years in 
congruence with a decrease in the use of the term DE in the same time span. This change from DE 
to ODL as a generic term might be a consequence of the openness movement in general and the 
use of OER, MOOCs, Web 2.0 and open spirit on networked Web environments in particular. 
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Figure l. Field specific keywords (N=633). 


The second finding is about the use of research specific keywords (Figure 2). For this analysis, all 
keywords were collected from papers and ranked according to their frequency of appearance in 
the articles in general. As The Journal of Distance Education doesn’t provide keywords for the 
articles, researchers defined keywords for the articles in this journal. For this analysis, all the 
keywords were ranked and the top 40 keywords were included in this research. Keywords that 
shared the same rank were ordered alphabetically. 

This descriptive keyword analysis demonstrates a five-year trend from many points of view, such 
as “OERs” as a movement, “mobile learning” as a technology based approach and “collaborative 
learning” as a pedagogy which are all noteworthy. Links implied between keywords is a further 
area deserving attention, for instance, the terms OERs, MOOCs and Web 2.0; interaction and 
social presence; Col (community of inquiry) and social networks may be related to one another 
and could be evaluated as a group of keywords rather than terms having solo meanings. 
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■ OER 

■ Mobile learning 

■ Collaborative learning 

■ Teacher education 

■ ICT 

■ Instructors I design 

■ Interaction 

■ MOOC 

■ Web 24) 

■ Community of inquiry 

■ Social presence 

aa Pedagogy 

■ Student perceptions 

h Collaboration 

■ Learning 

■ e-book 

h Social networks 
Virtual school 

b LMS 

■ Online discussion 

■ Technology 
Connectivism 
Educational technology 
motivation 

professional development 
teaching presence 
asynchronous 
asynchronous discussion 
Education 

Learning community 

Open Access 

student-support 

Synchronous 

Transactional distance 

Activity theory 

Communication 

Gender 

Hybrid course 

Hybrid learning 

Internet 


Figure 2. Top 40 keywords indicated more often than others (N=3455). 


The frequency count presents a descriptive analysis of the top 40 keywords. On the other hand, to 
understand and quantify the influence and importance of the relationship among these keywords, 
social network analysis (SNA) was conducted for the top 40 keywords and a complete network 
model was visualized based on their relations using centrality distribution. 

SNA is the mapping and measuring of relationships and flows between people, groups, 
organizations, computers, or other information and knowledge processing entities (Krebs, 2002, 
para. 1). The main goal of SNA is detecting and interpreting patterns of social ties among actors 
(De Nooy, Mrvar and Batagelj, 2011, p. 5). These networks usually visualized in a social network 
diagram, where nodes are represented as points and ties are represented as lines to conceptualize 
and to analyze them. 

For this analysis, the relationships of top 40 keywords (nodes) were identified on a 40x40 matrix 
and then these nodes were tied to each other manually by using SNA software. Following that, the 
raw data was visualized applying centrality measure analysis. As a result of this analysis, 40 nodes 
and 914 ties (edges) were observed. In terms of node betweenness centrality, used to measure the 
load and importance of a node, the keywords “learning” and “education” appeared as important 
nodes (Figure 3). This finding also confirms Zawacki-Richter and Anderson’s (2014, p. 9) 
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conclusion that the majority of published research deals with topics and issues with regard to 
“teaching” and “learning” processes in online distance education. 



Figure 3. A circular node betweenness centrality diagram. 


Research Areas 

As has been mentioned, in this study, the classification developed by Zawacki-Richter (2009) is 
used to define the research areas in DE. Upon analysis of the count numbers highlighted per year 
in the meta-levels of DE research classification, it can be seen that there is a strong imbalance 
between research areas and high over-representation of the micro level perspective. This finding 
also demonstrates similarities to previous research findings (Zawacki-Richter et al., 2009) and 
confirms the results of their content analysis. It is also interesting to note that interaction and 
communication in learning communities (13%), learner characteristics (12%), and instructional 
design (11%) from micro levels and educational technology (15%) from meso level constitute 51% 
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of all research areas (Figure 4). The meso level finding for “Educational technology” also confirms 
that DE is strongly related to technological developments. In addition to this peak in meso level, 
the peaks in micro level reflect the very nature of DE research. For instance, the result for 
“interaction and communication in learning communities” is based on web-based learning 
environments and social network sites; “learner characteristic” is a consequence of individual 
and learner centered approaches; and “instructional design” is a result of the emerging digital 
learning environments. 



Figure 4. Classification of research areas. 


Theoretical/Conceptual Backgrounds 

Since every research study should have adequate theoretical or conceptual backgrounds, 
investigating the theoretical/conceptual backgrounds indicated in the research articles can 
provide an insight about the current trends on what kinds of topics the researches are focusing on 
in any field. Therefore, in this study the theories and/or concepts stated in the articles were 
gathered and the top ten theories/concepts were ranked according to their frequency. 
Theories/concepts that share the same rank are ordered alphabetically. 

Those findings dealing with the theoretical/conceptual background of the articles indicate the 
nature of the new learning paradigm of 21 st century that focuses more on the learner rather than 
instructor or administrator. Col as a theory of knowledge formation and the process of scientific 
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inquiry rank as the most frequently used theoretical perspectives. Collaborative learning 
emphasizing active interaction between learners follows theoretical perspectives in the rankings. 
Constructivism, which argues that humans generate knowledge and meaning from interactions 
between their experiences and their ideas, is in third place. Connectivism as a learning theory for 
the digital age, though it has a very recent history, is also in third place and this may be a result of 
the growing impact of technology and networks on learning. 

It is clear that theories that explain how learning occurs on networks (connectivism, social 
networking) through collaboration in a community (community of inquiry, collaborative 
learning, social learning theory, activity theory) by interaction, based on immersion (critical 
thinking) and experience (constructivism, problem based learning, social constructivism theory) 
are favored by DE researchers. In addition to this, researchers focused on delivery methods 
(blended learning, mobile learning) that use multimedia elements (cognitive load theory) in 
which psychological distance (transactional distance theory) and presence (social presence 
theory) are important as well as learner dedication (self-regulated learning, self-directed 
learning, motivation theory). From this perspective, design (instructional design theories) for 
effective and efficient learning gained importance. After all, it wouldn’t be correct to attribute one 
single dominant theory that reflects theoretical trend in DE, but it would be a better approach to 
evaluate them as a whole since each theory intersects or overlaps at some points. 

On the other hand, Table 4 also shows that DE research is still, naturally, based on the concepts 
and the theories derived from the field of education. However, DE practice uses concepts, 
principles, models and theories of many other fields, such as engineering, communication, 
management, sociology and psychology. Therefore, it, most probably, would not be wrong to say 
that as DE researchers we must widen our search for theoretical/conceptual base to other fields 
than education and bring their concepts and theories into our field. That might help us develop 
the maturity of DE as a scientific field of study. 

Table 4 


Theoretical/Conceptual Background 


R* 

P** 

THEORY 

R* 

j?** 

THEORY 

1 

22 

Community of Inquiry 

8 

7 

Cognitive Load Theory 

2 

16 

Collaborative Learning 

8 

7 

Motivation Theory 

3 

15 

Constructivism 

8 

7 

Problem Based Learning 

3 

15 

Connectivism 

8 

7 

Self-directed Learning 

4 

14 

Blended Learning 

8 

7 

Social Constructivism Theory 

4 

14 

Transactional Distance Theory 

8 

7 

Social Learning Theory 

5 

11 

Mobile Learning 

9 

6 

Social Networking 

6 

10 

Activity Theory 

10 

5 

Critical Thinking 

6 

10 

Social Presence Theory 

10 

5 

Instructional Design Theories 

7 

8 

Self-regulated Learning 





R*: Rank, F**-.Frequency 
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Research Designs Employed 

Similar to many other fields, in a DE research study we might employ a quantitative, qualitative, 
or mixed research design. Table 5A presents what kinds of research design categories researchers 
in the field of DE preferred over the last five years. Table 5B and 5C provide the preferences on 
yearly bases. As shown in these tables the researchers in DE mostly conducted qualitative (47%) 
and quantitative (37%) studies, and just a few employed mixed (16%) designs. 

Zawacki-Richter et al. (2009) reported rates of 29.1% quantitative, 19.9% qualitative, 12.9% 
mixed and 38.1% other researches for 2000-2008 research trends (N=695). When comparing the 
results of 2000-2008 with 2009-2013, it may be seen that there has been a shift in the preference 
to qualitative and quantitative research design while mixed research design remains the same. 


Table 5A 

Percentage Of Research Methods Between 2009-2013 
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Table 5B 

Bar Chart Of Research Methods (Percentage Was Calculated Separately For Each Year) 

■ Qualitative ■ Quantitative Mixed 



2009 2010 2011 2012 2013 


Table 5C 

Line Chart Of Research Methods (Percentage Was Calculated Separately For Each Year) 



As an extension of the previous findings, this section of the content analysis presents the DE 
trends regarding research methodology (designs). Of all qualitative research designs, case studies 
(66%) that focus on a descriptive, exploratory or explanatory analysis of a person, group or event 
stand out. Design-based research (9%), phenomenology (7%), action research (5%), grounded 
theory (4%), ethnography (3%), content analysis (2%), meta synthesis (1%), narrative (1%), 
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historical (1%) and heuristic (1%) research models constitute 44% of the research models while 
case studies constitute 66% of all qualitative research design (Table 6). Berge and Mrozowski 
(2001) also reported that case study is the most preferred qualitative research design model 
(12.58%) between 1990 and 1999. 

Of all quantitative research design models, a great majority of studies preferred survey (58%) as a 
basic descriptive research model. The use of a correlational (29%) model that demonstrates the 
relationship between variables and the experimental (11%) model used to test cause-and-effect 
relationships between variables hold the next ranking positions. Finally, meta-analysis (2%) is 
seen to constitute a minor part of quantitative research design (Table 6). This data reveals that 
there is a need to conduct more quantitative correlational and experimental researches to 
understand and dig deeper into DE. 

These findings exhibit similarities with Berge and Mrozowski’s (2001) study for the research 
trends of 1990-1999. They reported a percentage of 74.83% descriptive, 6.63% correlational, 
5.96% experimental researches, all of which were quantitative research design models, and 
12.58% case study, a qualitative research design model (N=89o). 

Based on these data, it can be assumed that most of the quantitative DE researches are descriptive 
statistics which show or summarize sample data rather than inferential statistics which are used 
to test hypotheses and make estimations using sample data. This finding also supports and 
demonstrates a similarity to Panda’s (1992) conclusion for Indian distance education literature. 
He reported that most studies were descriptive surveys or experimental studies with poor 
methodological footing. 

Of all the mixed research design models, the exploratory (55%) model, in which researchers 
interpret how quantitative results build on initial qualitative results, and the explanatory (31%) 
model, in which researchers interpret how qualitative results help to explain initial quantitative 
results, constitute the majority of preferred research models. Convergent parallel (8%), embedded 
(4%) and multiphase (2%) follow as the other mixed research models that are preferred by the 
researchers (Table 6). 

Saba (2000) reported that, in contrast to pure experimental researches, DE goes beyond the 
narrow confines of experimentation and as a consequence began to use new methods in both 
qualitative and quantitative forms. These findings confirm Saba and also demonstrate a radical 
decrease in experimental research when compared to research conducted after the 50s. 

It is also interesting that in qualitative (case studies), quantitative (survey) and mixed studies 
(exploratory), one dominant research model has been used. However, assuming that DE is an 
interdisciplinary field, a wide spectrum of research models may be used. 

All in all, the findings obtained in this research reveal some interesting facts. In contrast to the 
modern paradigm, the world in which we live is not bipolar, but the research nature of DE 
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basically evolves around qualitative and quantitative research designs. On the other hand, within 
a post-modern perspective, more mixed research designs in which qualitative and quantitative 
data collection methods are used may be employed. 

Table 6 


Research Designs and Models 


Qualitative 
%47 (N= 349 ) 


a o 

J3P 8 


4 = 

fl- 


a 


s 

< 


s 

o 

U 


s 

c n 


%66 


%9 


%7 


%5 


%4 


%3 


%2 


%1 


%1 


%1 


%1 


Quantitative 
%37 (N= 278 ) 


%58 


%29 


%11 


%2 


%0 


Longitudinal 


Cross-sectional 


Prediction 


Comparative 


Relatio 

nship 


Experime 

ntal 


Quasi¬ 

experiment 

al 


£ .2 


O £ 


g <0 


Mixed 

%16 (N= 122 ) 


Exploratory 

sequential 


Explanatory 

sequential 


Convergent 

parallel 


Embedded 


Multiphase 


Transformative 


%55 


%31 


%8 


%4 


%2 


%0 


Data Collection Tools and Strategies Used 

The data collection instruments were also investigated in this study. As one can easily interpret by 
looking at Figure 5, the surveys, interviews and document analyses are the most preferred tools in 
the DE studies. A further analysis has shown that in the quantitative studies, the researchers most 
frequently used questionnaires and in the qualitative studies they preferred document analyses 
and interviews. 
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Figure 5. Data collection (instruments). 


Davies, Howell and Petrie (2010) presented trends in research and scholarship between 1998 and 
2007. They reported that the most frequently used data collection tools were survey (qualitative 
and quantitative) (N=i94), interviews (N=i28), existing artifacts (document analysis) (N=59), 
observations (N=17), researcher created assessments (N=i6), existing test scores (N=i6) and 
standardized assessments (N=is). When compared, it is clear that there is a strong similarity with 
current findings. 

However, it was interesting to note that log statistics were not used as much as they should have 
been since one of the latest and hottest topics discussed in the field is the learner analytics and 
use of available data to be able to get an insight about learner behaviors in online learning 
environments and to help them offer better, more customized learning opportunities. 

Data Analysis Techniques Employed in the Studies 

Table 7 presents the number of the data analysis techniques that were explicitly reported in the 
investigated articles. This was one of the most difficult analysis due to the fact that there were 
quite a number of articles that did not clearly inform about the data analysis technique(s) used, 
and also some, including those mixed method studies, comprised a variety of techniques. Despite 
these difficulties, the analysis has shown interesting findings. 

As can be observed in Table 7, one half of the quantitative studies included descriptive statistics 
(51%) and mainly used variability, central tendency and relative standing tests. Nonetheless, a 
majority of the researchers (N=72) reported that they used descriptive statistics but didn’t report 
which one of them was employed. In terms of inferential statistics (49%) parametric tests such as 
variance analysis, t-test, correlation, factor analysis, regression analysis, reliability analysis and 
structural equation modeling were extremely (85%) preferred while only in a few (15%) of the 
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articles that included quantitative studies, non-parametric tests such as Wilcoxon test, Mann 
Whitney-U, Kruskal Wallis test, chi-square and Friedman’s two way analysis were employed. 

Qualitative interpretive analysis generally uses content, thematic and discourse analysis in which 
raw qualitative data is transcripted, coded, categorized and interpreted. These findings 
demonstrate a similar trend in terms of quantitative statistical tests when compared to Davies, 
Howell and Petrie’s (2010) research regarding trends in distance education scholarship at 
research universities in North America between 1998 and 2007. They reported that most of the 
studies in their sample used descriptive data analysis predominantly. 

Table 7 

Tests and Analyses 


QUANTITATIVE 
Statistical tests 


Descriptive (51%) 


Inferential (49%) 


Parametric (85%) 


Non-parametric (15%) 


Variability 

(Variance-Standard Deviation- Range) 

163 

Variance analysis 

(ANOVA/MANOVA/MANCOVA) 

71 

Wilcoxon Test 

16 

Central Tendency (mean-median-mode) 

108 

t-test 

52 

Mann Whitney U 

15 

Descriptive statistics (not specified) 

72 

Correlation (Pearson) 

49 

Kruskal Wallis Ttest 

12 

Relative Standing (percentage/ z-score) 

11 

Factor Analysis 
(Confirmatory/Exploratory) 

48 

Chi-square 

6 



Regression analysis 

41 

Friedman's two way 
analysis 

2 



Reliability analysis (Cronbach's Alpha) 

24 





Structural Equation Modeling (SEM) 

3 




QUALITATIVE 

Interpretive Analysis (N=155) 

Content analysis 


76 

Thematic analysis 


74 

Discourse analysis 


5 


Variables Focused in the Studies 

Variables reported in the research studies examined were coded into main categories and ranked 
by frequency of appearance. 
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Table 8 

Variables Focused Most Often in the Articles Examined 


R* 

p** 

VARIABLES 

R * 

P** 

VARIABLES 

1 

53 

Perception 

9 

14 

Effectiveness 

2 

43 

Satisfaction 

9 

14 

Self-efficacy 

3 

39 

Gender 

10 

13 

Collaboration 

4 

30 

Interaction 

11 

12 

Communication 

5 

25 

Motivation 

12 

11 

Delivery 

6 

21 

Age 

13 

10 

Academic-performance 

6 

21 

Participation 

13 

10 

Impact 

7 

18 

Attitude 

13 

10 

Social-presence 

8 

16 

Experience 





R*: Rank, F**:Frequency 


As can be seen in Table 8, variables usually focus on the feelings, emotions and behaviour of the 
learners. ‘Satisfaction’ and ‘learner perception’ are the most often focused variables about 
learners’ emotions and feelings while ‘gender’ and ‘age’ are demographic non-parametric 
variables that have been examined more than other demographics in the investigated studies. 
These results can easily be linked to increasing attention to learners, their individual differences 
and the learner-centered approaches. 

Population and/or Participant Groups 

The research question regarding participants reveals interesting facts. As can be seen in Figure 6, 
participants of the studies examined are mostly undergraduate students (31%), post graduate 
students (10%) and academicians (10%). The fact that a total of 51% constitutes higher education 
also explains why the field specific keyword (higher education) ranks fourth in the list (Figure 1). 
This data reveals that DE focuses largely on higher education and there are only a few studies 
conducted in K-12 settings. An important portion of the researchers reported that their target 
groups were teachers (10%) and students (7%); on the other hand, researchers didn’t specify from 
which education level they came. Adult learners (4%), administrators (4%) and K-12 students 
(3%) appear in the list, respectively. 
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■ Bachelor's Students 

■ Post Graduate (Master and Doctoral students} 

■ Academician 

■Teachers 

■ Students 

■ Document 

u Adult Learners 
Administrators 

■ K-12 Students 
Specialists 
Institutions 
System/Program 
Associate Students 
Other 


Figure 6. Target groups and participants. 


In connection with these findings, DE education has roots in lifelong learning philosophy and 
covers formal, informal and non-formal learning, a finding which reveals that any age or 
occupation area can be a target group of these researches. On the other hand, K-12 students 
representing the formal education level prior to higher education and adult learners representing 
the latter education or learning process following higher education constitutes only 7% of total 
target groups. One explanation for the connections may be that it is more convenient to work with 
students from higher education since the researchers work in the same institutions. However, K- 
12 is another setting in which DE is getting popularity (Lips, 2010; Queen & Lewis, 2011). It was 
interesting to find that the research studies have not reached the expected level in K-12 settings, 
yet. One easily can predict that there will be more DE research in K-12 settings in near future. 

Authors Cited Most Often 

In this part of this research, leading contributors in the field were determined in terms of the 
number of citations (Table 9). The total number of citations was 53,800. A total of 105 authors 
who have been cited at least 30 times are included in the table. Authors that share the same rank 
are ordered alphabetically. 

It was quite interesting to note that UNESCO is 38 th on the list. It may mean that as an 
institution, UNESCO has a key role for DE and lifelong learning. A full list of the most cited 
authors (N=ios) is given in Appendix A. In contrast to some researches (Lee et al., 2004), to 
identify their significant impact to the field, not only first authors but also second, third and other 
co-authors were counted with an assumption that every author contributes to these works. 
Therefore, one should assume that collaborative works are more advantageous than solo works 
since the authors who have more collaborative works counted more than once in Table 9. 
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Table 9 

List of Most Cited Authors (Top 20) 


R* 

p** 

Author 

R* 

P** 

Author 

R* 

F ** 

Author 

1 

520 

GARRISON, D.R. 

8 

129 

SWAN, K. 

15 

94 

ARBAUGH, J.B. 

2 

405 

ANDERSON, T. 

9 

109 

ROVAI, A.P. 

16 

90 

WENGER, E. 

3 

208 

MOORE, M.G. 

10 

105 

ALLEN, I.E. 

17 

88 

CLEVELAND-INNES, M 

4 

207 

ARCHER, W. 

11 

103 

SIEMENS, G. 

18 

81 

WILEY, D. 

5 

145 

SEAMAN, J. 

12 

102 

DOWNES, S. 

19 

79 

KANUKA, H. 

6 

135 

SHEA, P. 

13 

101 

BONK, C.J. 

20 

77 

SALMON, G. 

7 

129 

ROURKE, L. 

14 

100 

GUNAWARDENA, C.N. 




R*: Rank, F**:Frequency 


Another result we obtained from these findings is common citation mistakes. It is important to 
cite references properly as well as to explain the research process in detail in order to help readers 
reading and to show respect to the researchers who contributed to the relevant study and to the 
field. It was observed that researchers whose name and surname consist of three parts (e.g. D. R., 
Garrison) or who have names of Far East origin (e.g. Chih-Hsiung Tu) were usually cited 
incorrectly. To give an example, in some papers D.R. Garrison is cited as Garrison, D. R., 
Garrison, D., or Garrison, R. and Chih-Hsiung Tu is cited as Tu, C.H., Tu, C-H., or Tu, C. Though 
not a research trend in itself, this problem is one of the points that made the analysis of the 
citation trends quite difficult. 

References Cited Most Often 

This part of the content analysis regarding citation trends presents the most cited works (articles, 
books, web sites, etc.) within the articles analyzed in the study. We believe that this list presents a 
comprehensive citation trend and may help researchers as a reference guide and as a reading list 
for those who study in this field (Table 10). This table was created by filtering 28,500 references 
that have been cited at least 10 times. Studies sharing the same rank were ordered by the 
publication date and if two studies had the same rank and publication date, they were ordered 
alphabetically. Older studies were ranked at the end and newer studies are ranked at the 
beginning. References were also categorized according to their type (article, book, book chapter, 
etc.). 
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Table 10 

The Reference List of Most Cited Studies (Top 15) 


R* 

F** 

7*** 

References 

1 

62 

A 

Garrison, D. R., Anderson, T., & Archer, W. (1999). Critical inquiry in a text-based environment: Computer conferenc 
in higher education. The internet and higher education, 2(2), 87-105. 

2 

53 

B 

Vygotsky, L. S. (1980). Mind in society: The development of higher psychological processes. Harvard University Press 

3 

51 

B 

Moore, M. G. & Kearsley, G. (1996). Distance education: A Systems View. Canada: Wadsworth. 

4 

43 

A 

Moore, M. G. (1989). Editorial: Three types of interaction. American Journal of Distance Education, 3(2), 1-7. 

5 

40 

C 

Moore, M. G. (1993). Theory of transactional distance. In D. Keegan (Ed.), Theoretical principles of distance educatio 
(p 22-38) New York: Routledge. 

6 

35 

B 

Jean. Lave, & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Cambridge University Press. 

6 

35 

B 

Patton, M. Q. (1980). Qualitative evaluation and research methods. SAGE Publications, inc. 

7 

34 

R 

Means, B., Toyama, Y., Murphy, R., Bakia, M., & Jones, K. (2009). Evaluation of Evidence-Based Practices in Online 
Learning: A Meta-Analysis and Review of Online Learning Studies. US Department of Education. 

7 

34 

R 

Allen, I. E., & Seaman, J. (2008). Staying the Course: Online Education in the United States, 2008. Sloan Consortium, 
Newburyport. 

7 

34 

A 

Garrison, D. R., & Arbaugh, J. B. (2007). Researching the community of inquiry framework: Review, issues, and futur 
directions. The Internet and Higher Education, 10(3), 157-172. 

7 

34 

A 

Anderson, T., Liam, R., Garrison, D. R., & Archer, W. (2001). Assessing teacher presence in a computer conferencing 
context. Journal of Asynchronous Learning Networks, 5(2), 1-17. 

7 

34 

B 

Salmon, G. (2000). E-moderating: The key to teaching and learning online. Psychology Press. 

8 

33 

B 

Garrison, D. R., & Anderson, T. (2003). E-learning in the 21st century: A framework for research and practice. Tayloi 
Francis. 

9 

32 

W 

Siemens, G. (2004). Connectivism: A learning theory for the digital age. Retrieved from 
http: / /www. eleam space, org/ Articles/connecti vism .htm 

10 

31 

B 

Wenger, E. (1998). Communities of practice: Learning, meaning, and identity. Cambridge University Press. 

11 

30 

R 

Allen, I. E., & Seaman, J. (2010). Learning on Demand: Online Education in the United States, 2009. Sloan Consortiu 
Newburyport. 

12 

28 

R 

Watson, J., Gemin, B., Ryan, J., & Wicks, M. (2009). Keeping Pace with K-12 Online Learning: An Annual Review of 
State-Level Policy and Practice, 2009. Evergreen Education Group. 

12 

28 

A 

Tallent-Runnels, M. K., Thomas, J. A., Lan, W. Y., Cooper, S., Ahem, T. C., Shaw, S. M., & Liu, X. (2006). Teaching 
courses online: A review of the research. Review of educational research, 76(1), 93-135. 

12 

28 

A 

Garrison, D. R., Anderson, T., & Archer, W. (2001). Critical thinking, cognitive presence, and computer conferencing 
distance education. American Journal of distance education, 75(1), 7-23. 

12 

28 

B 

Yin, R. K. (1984). Case study research: Design and methods. SAGE Publications, inc. 

13 

27 

A 

Garrison, D. R., & Cleveland-Innes, M. (2005). Facilitating cognitive presence in online learning: Interaction is not 
enough. The American Journal of Distance Education, 19(3), 133-148. 

14 

24 

A 

Downes, S. (2007). Models for sustainable open educational resources. Interdisciplinary Journal of Knowledge and 
Learning Objects, 3, 29-44. 

15 

23 

B 

Organisation for Economic Co-operation and Development. (2007). Giving knowledge for free: The emergence of opei 
educational resources. OECD Publishing. 


R*: Rank, F**: Frequency, T***:Type (A: Article, B:Book, BL: Bulletin, C:Chapter, P: Paper, R: Report, W: Web Page) 
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Summary and Future Implications 

The results of this study reveal research trends and issues in DE emerging from scholarly 
publishing in seven prestigious journals. This study intends to present the current situation and 
provides a research direction for future research. The results can be summarized as follows. The 
generic term defining the field is “distance education” and another term “open and distance 
learning” has been used more and more as a consequence of the paradigm shift in education. The 
analysis of research specific keywords clearly indicates that DE demonstrates quick responses to 
emerging research topics. A holistic analysis of these keywords through social network analysis 
demonstrates that “learning” is the major topic in the field naturally. Open education resources 
(OERs) and mobile learning are new topics over the last five years DE researchers also focused on 
along with older topics, such as collaborative learning and teacher training. 

The analysis of research areas portrays that educational technology from meso level, interaction 
and communication in learning communities, learner characteristics, and instructional design 
from micro levels are the most studied areas and constitute 51% of all fifteen research areas. 
Another result obtained through this study is that DE researchers employ different theoretical 
frameworks to explain and explore the DE field which also reflects the interdisciplinary nature of 
the field. 

In terms of methodology, DE usually preferred qualitative, quantitative, or mixed research 
designs, respectively. Most of the qualitative studies used case study, quantitative studies used 
survey, and mixed studies used exploratory and explanatory research models. It can be also seen 
that qualitative researches preferred interviews (one-to-one and focus group), document analysis 
and observation while quantitative researches used questionnaires and scales to collect data. In 
the quantitative research studies, descriptive and inferential statistics were used almost equally. 
In the qualitative research, content and thematic analysis to interpret the data collected were 
generally preferred. Variables focused in the studies are usually concerned with learners’ feelings, 
emotions and behaviors. Gender and age seem to be indispensable demographic variables of the 
studies. The main participants of these research studies still appeared to be learners in higher 
education, but there is a trend of focusing more on participants from the K-12 settings. 

In the final part of the study, the most cited authors and references were presented. In addition to 
providing leading researchers and important references, descriptive analysis of citation trends 
proved once again that DE uses knowledge of the past and present to be able to foresee the future. 

Regarding the results of this study, the following implications can be taken into consideration for 
future researches: 

• There are many terms defining the DE field. Even though they all look similar, they reflect 
unique aspects of the field. Thus, researchers need to select appropriate field specific terms 
that reflect the core of the study. However, it seems the term ‘open and distance learning’ is a 
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better name for our field of study since it reflects the core assumptions of the field: openness, 
accessibility, flexibility, massiveness, and quality learning opportunities to all. 

• This study presented the most and the least studied research areas in the field. Considering 
that DE is a system, those neglected areas should be studied more in order to contribute to 
and improve the field. The authors of the present paper believe further study into why some 
research areas appear to be less popular would contribute richly to future research. The 
studies should not focus on only general characteristics of the learners, such as gender and 
age, but also various individual differences including cognitive processes, learning strategies, 
cultural differences. Additionally, we need studies examining the learning processes in 
informal, non-formal learning environments as well as OERs and MOOCs to be able to 
provide better learning opportunities. Bringing concepts, principles, models and theories 
from a variety of fields - especially from those that we use in DE practices often - might be 
beneficial for the development of the field. Especially, graduate students must be encouraged 
to use theoretical/conceptual backgrounds from different fields. For instance, business 
management field is a rich field of study that might help enlighten some of the issues of our 
field such as business models for MOOCs, OERs, recognition of prior learning. 

• As an interdisciplinary field, we believe that rather than using specific research designs and 
models, researchers may use a variety of them to understand and to delve more deeply into 
the area. Especially mixed designs might help scientific development of the field. It is seen 
that participants and target groups are generally adult learners from higher education. 
However, we believe that research that targets K12 students might be conducted more 
considering the increasing use of e-learning in K12 settings. 
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